Tuning phase transition between quantum spin Hall and ordinary insulating phases 
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An effective theory is constructed for analyzing a generic phase transition between the quantum 
spin HaU and the insulator phases. Occurrence of degeneracies due to closing of the gap at the 
transition are carefully elucidated. For systems without inversion symmetry the gap-closing occurs 
at ±fco(7^ G/2) while for systems with inversion symmetry, the gap can close only at wave- numbers 
k — G/2, where G is a reciprocal lattice vector. In both cases, following a unitary transformation 
which mixes spins, the system is represented by two decoupled effective theories of massive two- 
component fermions having masses of opposite signs. Existence of gapless helical modes at a domain 
wall between the two phases directly follows from this formalism. This theory provides an elementary 
and comprehensive phenomenology of the quantum spin Hall system. 
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I. INTRODUCTION 

The intrinsic spin Hall effect (SHE)^'^ driven by 
the relativistic spin-orbit interaction and the associated 
Berry curvature of the Bloch wavefunctions attracts con- 
siderable attention both theoretically and experimen- 
tally. In conducting materials such as doped GaAs, the 
external electric field produces transport current and dis- 
sipation, even though the spin current transverse to it is 
dissipationless. Therefore it is highly desirable to design 
systems showing the SHE without dissipation. Spin Hall 
insulator (SHI) has been proposed for this purpose by 
some of the present authors, and its candidate materials 
are HgTe, PbTe, a-Sn and so fortb^. These band insu- 
lators are predicted to show finite spin Hall conductivity 
afj, which is not quantized and depends on parameters 
in the model Hamiltonian. Later it has been realized 
that gapless edge modes in semi-infinite systems do not 
exist in generic cases. These two features, i.e., the non- 
quantized crfj and the absence of gapless edge modes, are 
closely related to the absence of conserved spin current 
in the presence of spin-orbit interaction, i.e., there is no 
U(l) gauge symmetry for spin current. Therefore it was 
difficult to distinguish between the SHI and usual insu- 
lators. 

Recently, Kane and Mele proposed a model for time- 
reversal (T-) invariant systems^i^, which manifests a fi- 
nite SHE and demonstrated its distinction from an ordi- 
nary insulator due to the topological nature of its ground 
state. The pertinent Z2 topology is represented by an 
integer A defined for Bloch wavefunctions in the bulk, 
whose parity distinguishes the relevant phases. Physi- 
cally, A is identical with the number of pairs of heli- 
cal edge modes. In a system with A = odd, referred to 



as quantum spin Hall (QSH) system^^'^^l'^-^^i^^^^^i^^i^, 

the odd number of pairs of helical edge modes is robust 
against weak nonmagnetic disorder and interaction o^^'^^ . 
When A = even, gapless edge modes can hybridize each 
other and a gap will open even at the edge. The system 
is then referred to as spin Hall insulator (SHI). Transi- 
tions between phases with A = even (SHI) and A = odd 
(QSH) occur only when the gap is closed by tuning pa- 
rameters of the model. Constructing a theory for analyz- 
ing these transitions is a challenge of paramount interest. 



In this paper, we develop an effective continuum the- 
ory for phase transitions between QSH and SHI systems 
in 2D and discuss (i) classification of the possible types 
of transition, (ii) existence of gapless helical edge modes, 
and (iii) the change of the Z2 topological number at the 
transition. The basic idea is that effective continuum the- 
ory focusing on the vicinity of the gap-closing points at 
the transition can be constructed even though character- 
ization of each phase requires information over the whole 
first Brillouin zone. Namely, the change across the phase 
boundary is much easier to elucidate, and the relation be- 
tween the topological number and the helical edge modes 
is rather transparent. This work concerns local features 
in k space, and is complementary to Refs. [5II26I which 
treats global topological structure in k space. We ignore 
interaction and disorder effect in this paper, since the 
robustness of the system is inferred from the topological 
stability. 
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II. GAP CLOSING AT THE PHASE 
TRANSITION 

Since the phase transition necessarily accompanies 
closing of the gap ^'^'^° , we commence with an analysis 
of generic gap-closing in a two-dimensional (2D) gapped 
spin- 1/2 T-symmetric system with spin-orbit interaction. 
A Hamiltonian matrix for Bloch wavefunctions can be 
written in a block form, 



Hik) 



(1) 



The dimension of the matrix ha-a' (k) depends on systems 
considered; nevertheless, in order to describe the phase 
transition, it is sufficient to restrict the dimension of the 
matrices ha-a' (k) to be one or two, as we will see later. 
To investigate the topological order of the Hamiltonian, 
its spectrum is assumed to have a gap, within which the 
Fermi energy lies. The T-symmetry is represented by 
the operator, O — iUyK {'Jx.y,z are Pauli matrices and 
K stands for complex conjugation). For H[k) it implies. 



H{k) = ayH^{-k)a. 



(2) 



or, equivalently, /i||(A;) = K^^{—k) and /i||(/c) = 

— A;). This, in turn, results in a degeneracy between 

states at k and —k, forming Kramers pairs. 

Tuning some parameters in the Hamiltonian may drive 
a transition, where the gap closes and degeneracies be- 
tween the valence and the conduction bands occur at cer- 
tain wavevectors k = [k^, ky). To pursue the phase tran- 
sition, we will focus on "generic" gap-closing achieved by 
tuning a single parameter m. (For mere convenience, the 
critical value of m for which a generic gap-closing occurs 
is chosen as m = 0.) Non-generic gap-closing achieved by 
tuning several parameters are excluded in our analysis. 
This is because such kind of gap-closing can be circum- 
vented by small perturbation, meaning that it cannot be 
associated with a phase transition. As we show below, 
generic gap-closing are classified into two cases shown 
schematically in Fig. [1] (a) (b) (depending on symmetry 
under parity). We note that while we have not made any 
assumption on the Z2 topological number, both cases (a) 
and (b) turn out to encode quantum phase transitions be- 
tween the QSH and the SHI phases. Among the known 
models describing this kind of phase transition, the Kane- 
Mele model on the honeycomb lattice^ falls within class 

(a) while the HgTe quantum well model^^ belongs to class 

(b) . 

The QSH-SHI phase transitions pertaining to Fig. [1] 
(a)(b) are not so trivial as it might look. In general, 
energy levels repel each other, thereby the valence and 
the conduction bands do not touch when the number of 
tuned parameters is not large enough. The number of 
tuned parameters to achieve degeneracy, called the codi- 
mension, is sensitive to the symmetry and the dimension 



of the system considered. For example, in three dimen- 
sions the gap-closing of the type (a) in Fig. [T] does not 
1 q 

occur—. 

Consider now a spatial inversion (I-)symmetry which 
plays an important role beside T-symmetry. The for- 
mer requires the relation Enaik) — £na{—k), while the 
latter implies £na(k) = e„g(— ^), where £na{k) is the 
energy of band n with pseudospin a, and a is the pseu- 
dospin opposite to a^^ . If both symmetries are respected, 
£na{k) — £na{k) and there is a Kramers double degen- 
eracy at each k. If I-symmetry is broken, double degen- 
eracy occurs at points k — —k + G, i.e. k — ki = G/2, 
where G is a reciprocal lattice vector; no double degener- 
acy occurs at other points (unless an additional symme- 
try is present). The I-asymmctric and I-symmetric cases 
are therefore considered separately below. 



A. Inversion asymmetric systems 

In this case, when k ^ —k + G, each band is non- 
degenerate, and the gap between two bands can close at 
some points k. At the gap-closing point, one valence 
band and one conduction band become degenerate. The 
codimension is three^^. This codimension three is equal 
to the number of parameters involved, that is, k^, ky and 
TO. Thus the gap can close at some k when the parameter 
TO is tuned to a critical value. 

On the other hand, when k — —k + G, the band is 
doubly degenerate, and the codimension is fiv o^^i^^ , ex- 
ceeding the number of tunable parameters which is one 
(that is, to). Thus, generic gap-closing cannot occur at 
^ = G/224. 

We thus focus on the case k ^ G/2. Near the gap- 
closing point k = ko{j^ G/2), the system's Hamiltonian 
corresponds to massive two-component fermion, and can 
be expressed as Ti. = mUz + {kx — kQx)o'x + (ky ^ kQy)ay 
(after unitary and scale transformations). T-symmetry 
requires that the gap closes simultaneously at fco and —ko 
as depicted in Fig. [T] (a), and that the masses at fc = 

±fco have opposite signs. In the honeycomb-lattice model 
for QSH**-^ the gap closes at the K, K' points; Hence it 
reduces to the present scheme without I-symmetry. 



B. Inversion symmetric systems 

In this case, the energies are doubly degenerate at each 
k. At the phase transition, the gap between the two 
doubly-degenerate bands closes. Hence, we consider 4x4 
Hamiltonian matrix H{k) {hap{k) in Eq. ^ are 2x2). 
The I-symmetry is imposed as 



H{-k) = PH{k)p-^, u{-k) = Pu{k), 



(3) 



where P is a unitary matrix independent of fc, and u{k) 
is the periodic part of the Bloch wavefunction: fjiir) = 
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FIG. 1: Generic gap-closing for (a) inversion-asymmetric and 
(b) inversion-symmetric cases. In case (b) all the states are 
doubly degenerate by Kramers theorem. 



L{k)t 



As the inversion does not flip spin, this unitary 



matrix P should be block-diagonal in spin space: 



P 



Pi 



(4) 



In fact, all cases reduce to a case P| = = diag(?7a, Vt) 
with r]a = ±1, rjh — ±1, as can be shown directly by 
applying a unitary transformation, rja and 77b represent 
the parity eigenvalues of the atomic orbitals. 

Occurrence of gap closing turns out to be different for 
the cases (i) rja — rjb and (ii) rja = —ilb- The case (i) 
Va — Vb = il is realized when the atomic orbitals a, b 
have the same parity, such as two s-like orbitals or two p- 
like orbitals. The ensuing constraints on the Hamiltonian 
are: — hj^ is an even function of k, and h'ji = /ij^ 

is an antisymmetric matrix, even function in k. In an 
explicit form, the generic Hamiltonian becomes 



Hik) = Eo{k)+Y,a^{k)^, 



(5) 



where a^'s and Eq are real even functions of k. Ti are 4x4 
matrices given hy Ti — 1(E) t^, T2 = cTz 'Si Ty, — 1(E) Tz, 
T4 = (Jy(E)Ty, and r5 ~ (Ta; , where ai and ti are Pauli 
matrices acting on spin and orbital spaces, respectively. 

The Eigenenergies are given by Eq ± ^Jj^^^i a|. The gap 

closes when ai{k) = for i = 1, ■ • ■ ,5. It means that the 
codimension is five, the same as in the case at k — G/2 
without I-symmetry. Thus there are no solutions of k^, 
ky and m which satisfy these five relations. The gap 
never closes in this case. 

Next we consider the case rja = —rjb = ±1, i.e. P = 
rjaTz = iTz, where the two constituent atomic orbitals 



have different parity. The Hamiltonian reads. 



(6) 



where ao(fc) and 05 (fc) are even functions of fc, and 6*^'^ (fc) 
are odd functions of k. Here are 4x4 matrices given 
by T[ = (TzE)Tx,T'2 = l(^Ty,T'^ = a^E)T^,T'4^ = ay(^T^, 
and Fg = 1 ® Tz . In this case the gap closes only when 
five equations 05 (fc) ~ 0, b'^^\k) ~ are satisfied. For a 
generic point k with k ^ G/2, these five equations cannot 
be satisfied simultaneously, through a change of a single 
parameter—. On the other hand, at the high-symmetry 
points k = ki = G/2, the situation is different. At these 
points the odd functions b^'^\k) vanish identically, and 

one has only to tunc a^{k) to be zero. Thus, the gap 
closes by fine-tuning a single parameter. To be more 
specific, we take A: = as an example, and write down 
the Hamiltonian explicitly. Extension to other k = G/2 
points is straightforward. The Hamiltonian is expanded 
to linear order in k as 



H{k) Eo + mF^ 
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E 

1=1 



(7) 



where Eq and m are constants, and {i — 1, ■ • ■ ,4) 
are two-dimensional real constant vectors. Further sim- 
plification is obtained after judicious unitary transfor- 
mations. The Hamiltonian finally acquires the block- 
diagonal form. 



Hik) = Eo 



m 



— m 



m 



— m / 



(8) 



where z± = bikx + b^ky ± ib2ky with real constants 61, 
62 and 63. Note that in materials with high crystal- 
lographic symmetry (e.g tetragonal), one has bi = 62 
and 63 = 0, leading to z± oc /c^; ± iky. We have thus 
demonstrated a feature: The Hamiltonian of a generic 
system with spin-orbit coupling obeying T- and I- sym- 
metries decouples, after an appropriate choice of basis, 
into a pair of Hamiltonians describing two- component 
fermions with opposite sign of the corresponding mass 
terms. (Such decoupling is expected in the special case 
where Sz is a good quantum mmiber, since the system 
describes two copies of a quantum Hall system). Exper- 
imental consequences are immediate as the Hamiltonian 
([5]) is equivalent to the one suggested for the HgTe quan- 
tum well in Ref. [l^ (based on phenomenological argu- 
ments). Gap closing at fc = when the parameter m is 
tuned to zero is now obvious, since the eigenenergies are 
E — Eq zt ^ m? Z+Z-. The inversion matrix in this 
basis is written as r]aE)Tz — 77adiag(l, —1, 1, —1). 

Summing up to this point, we discussed generic types 
of gap closing in time-reversal invariant systems, achieved 
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by tuning a single parameter. Taking I-symmetry into 
consideration, two types of gap-closing scenarios have 
been found: (a) simultaneous gap closing at fc = ±fco ^ 
G/2 occur in systems without I-symmetry, and (b) gap 
closing between two Kramers-degenerate bands (i.e. four 
bands) at k = G/2 occur in systems with I-symmetry 
(see Fig. [1]). Due to the level repulsion, the gap-closing 
by tuning a single parameter occurs only in limited cases. 
We will see in the subsequent discussion that these cases 
of gap-closing exactly coincides with the phase transi- 
tion between the QSH and the insulating phases. In this 
sense our theory characterizes the QSH phase from the 
local features in k space. 



C. Change of the Z2 topological number at the 
gap-closing point 

Now we focus on the change of Z2 topological num- 
ber at the gap closing, assuming that except for the gap 
closing (m — 0) the bands are fully gapped. Hence, both 
phases at m > and m < are band insulators, and have 
well-defined Z2 topological numbers. For the I-symmetric 
case (a) , the homotopy characterization in Ref. [2^ is ap- 
plicable; for the lower band at the critical value m = 0, 
there is one vortex at and one antivortex at — /jq- Thus, 
when the parameter m is tuned across to = 0, the Chern 
number for the whole contracted surface^S. changes by 
one. Thus, the Z2 topological numbers are different by 
one for the to > and the m < sides. One of the phases 
is the QSH phase, while the other is the SHI. For the I- 
symmetric case (b), Fu and Kane^ developed a simple 
method to calculate the Z2 topological number A as 



N 



(-i)^=nn^2™(fc.), 



(9) 



= 1 m=l 



points, and A'' is the number of Kramers pairs below Ep. 
In the present case the gap at A: = collapses when to — 
0. Hence only the parity eigenvalue at fc = can change 
at the phase transition. Since the inversion matrix is 
given hy P = ria®Tz = rjaOQ ® Tz, the parity eigenvalues 
are —rja{~ rji,) and +r]a for the lower-band states at to > 
and m < 0, respectively. Hence, the parity eigenvalue 
changes sign, and the Z2 topological number A changes 
by one. Thus, on the two sides of the band touching, 
TO > and TO < 0, one of the phases is the QSH phase, 
while the other one is the simple insulator (SHI) phase. 



III. HELICAL EDGE STATES 

Let us regard the usual insulating phase as our vacuum, 
so that the domain wall between the QSH phase and 
the insulating phase is the edge of the sample. Such a 
domain wall is described by a spatially dependent mass 
parameter m(x) satisfying m(±oo) = ±too, i.e.. 



Too : a; ^ 
—Too : a; <C 0. 



(10) 



where ki are the four high-symmetry points satisfying 
k = G/2, £,2m{ki) is the parity eigenvalue at each of these 



We do not specify the detail of the crossover between too 
and —Too, because it is not important for the subsequent 
discussions. For Fig. [Tfa), one can consider the Weyl 
fermions at fc = ±fco separately. Masses of these Weyl 
fermions change sign at to = 0; hence they yield the 
edge states localized at the domain wall, as explained 
in Ref. i27|. Because the Weyl fermions at fc = ±fco are 
related to each other by time-reversal symmetry, the two 
edge states form a Kramers pair. 

For Fig. [IKb) with a domain wall PTI)) . we follow the 
discussion in Ref. [13 to show that such domain wall be- 
tween phases with different Z2 topological number pos- 
sesses one Kramers pair of edge states at the boundary. 
In this case we consider 



Hiky) = Eo 



I TO -ibidx + (63 - ib2)ky 

-ibidx + (^3 + ib2)ky -to 



V 



ibid^ - (63 - ib2)ky 

To calculate the eigenstates it is convenient to perform unitary transformation as 

^ b2ky TO - bidx 

H'{ky) = Q^H{k)Q = Eo + 



ibidx - {b3 + ib2)h 

— TO 



(11) 



TO + bidx —b2ky 



\ 



—b2ky TO — bidx 
TO -f bidx b2ky 



(12) 



where We omit the term Eq henceforth, since it does not af- 




g ^ ^-tb;kyx/b, I « * _ . _ . I . (13) 
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feet the subsequent discussions. The eigenvalue problem 
reads as H'{ky)uk^{x) = E{ky)uky{x). 

Because (fT2|) is block-diagonal, we first solve the eigen- 
value problem for the first two components of Uky , i-e we 
put Uky = (wi, U2, 0, 0)*. We get 



(E - b2ky)ui = Du2, 
{E + b2ky)u2 ^ D'^ui, 



where D 



dx ' 



eigenequations for ui and U2, respectively: 

DD^ui = {E^-blkl)ui, 
Du2 = (E^ - bjkl)u2, 



(14) 
(15) 

They yield 



(16) 
(17) 



When we solve Eq. for ui, one can calculate U2 from 
(fT5| . As p6)) is invariant under E ^ —E, it seems that 
the solutions for E and —E are always obtained simul- 
taneously, namely there is a spectral symmetry between 
E ^ —E. Nevertheless, it does not apply if i? = — 62^^, 
where ([T5|) cannot be solved for U2- A similar situation 



occurs for E = 62 fc^. Thus exceptions at E = ±b2ky 
occur in the following way. For ui{^ 0) which satisfies 
D^ui — 0, we get E = b2ky and U2 — from Eqs. 
and (jlSp . whereas there is no solution with E — —b2ky. 
In the same token, for U2 which satisfies Du2 = 0, we get 
E = ~b2ky from (jl4p . whereas there is no solution with 
E = b2ky. Hence the spectral asymmetry is related to 
the kernels for D and D^. For simplicity we take 61 > 
henceforth, while the other case of 61 < can be studied 
in a similar way. For the domain wall pI7)) . the solution 
of D^ui = gives 



Ml oc exp 



m{s)ds 



(18) 



and E = 62^^, while Du2 = has no normalizable so- 
lution. Thus the energy dispersion in ky direction has a 
branch E = b2ky, which crosses the Fermi energy E ^ 0. 
This state is gapless, localized near x ~ 0. 




FIG. 2: Schematic dispersion curves for the model 
Kramers theorem guarantees that the crossing of two edge 



states occur at ky 



0. 



So far we have solved the eigenequation for the first 
two components. The lower two components of the wave- 
function u is obtained from above by time-reversal op- 
eration {Qu{ky) = i(T2u{—ky)* ). Therefore, the above- 
mentioned edge state with E — b2ky has a Kramers part- 
ner with E = —b2ky. The whole dispersion is shown 
in Fig. [2I Thus we have shown that the Kramers pair 
of edge states exists at the boundary between the two 
phases. They cross at ky = 0, as is guaranteed by the 
Kramers theorem. 



IV. CONCLUSIONS 



A general framework is established for classifying phase 
transitions between the quantum spin Hall and the in- 
sulator phases. For inversion-asymmetric systems, the 
phase transition accompanies a gap closing ai k = iko 
which is not at the high-symmetry points. For inversion- 
symmetric systems, the gap closes only at k — G/2 where 
G is a reciprocal vector. All the known models exhibiting 
phase transition between the two phases are special cases 
of this general classification framework. 
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